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What is OpenGL ES 2.0? 


© OpenGL for Embedded Systems 

© OpenGL ES 2.0 
Fully shader-based 
Based on ES Shading Language 
Draft spec released at SIGGRAPH 05 
Spec ratified and released at GDC 07 
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OpenGL ES 2.0 - Widespread 

Industry Support 

® OpenGL ES 2.0 support announced from 
many companies: 

AMD 

NVIDIA 


Imagination Technologies 


ARM 

...and more... 


® OpenGL ES 2.0 will become ubiquitous 

CMr' 
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ES 2.0 - The Problem for 
Game Developers 

Developers need to develop their game 
engines in advance of new hardware 

No hardware available today 

OpenGL ES 2.0 may require handheld 
developers to change their engines 
significantly 

Shader-based API moves more burden to the 
application 

Enables more flexibility through 
programmability 
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ES 2.0 - A Development 

Solution 

OpenGL ES 2.0 Emulator 

OpenGL ES 2.0 implementation for Win32 

Allows developers to write their engines in 
advance of hardware 

OpenGL ES 2.0 RenderMonkey 

Develop OpenGL ES 2.0 shaders and effects 
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OpenGL ES 2.0 Emulator 


OpenGL ES 2.0 Emulator 

Goals 





Provide an OpenGL ES 2.0 development 
environment on the PC 

Minimize porting effort once hardware is 
available 


© Leverage features/performance of 
desktop hardware 
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OpenGL ES 2.0 Emulator - 

What is it? 



© Khronos standard header files 
© Example programs 
© Utilizes desktop hardware for rendering 


Requires desktop OpenGL 2.0 hardware 
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OpenGL ES 2.0 Emulator - 
Usage Overview 
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OpenGL ES 2.0 Emulator - 

Features 







OpenGL ES 2.0 Core API 

@ Full OpenGL ES 2.0 Implementation 

Optional Extensions: 

@ 10.10.10.2 Vertex/Texture Data 
@ FP16 Vertices and Textures 
@ 3D and Non-Power-2 Textures 
@ Compressed Texture Formats 
® ETCl, ETC3, ETCS, ATI_TC 
@ Occlusion and Conditional Queries 
@ Depth Textures 
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OpenGL ES 2.0 - Demo 
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OpenGL ES 2.0 Emulator - 
Enables Developers 

More than just a prototyping tool 

Graphics code should move over easily from 
emulator to real hardware 


© Mirrors top tier handheld developer 
approaches 

Prototype on the PC 

Move to handheld device as a final step 
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OpenGL ES 2.0 Emulator 



© Contact devrel@amd.com for more 
information 


© PowerVR also provides an emulator and 
SDK: 

http://www.powervrinsider.com 
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Render Monkey - OpenGL 

2.0 Support 







What is RenderMonkey? 






Shader Development Environment 

Rapid Prototyping of Shader Effects 

Multiple Shading Languages 

OpenGL ES Shading Language 

OpenGL Shading Language 
DirectX HLSL 
DirectX Assembler 



i; 
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RenderMonkey - Why use it? 

® Full IDE for shader effect development 

@ Programmer and artist view for rapid iteration 

® Easy integration into game pipeline 


@ Plug-in SDK for custom import/export 
® Effects, models, textures, variables, etc. 
@ Support for many standard formats 
® DDS, BMP, TGA, X, OBJ, 3DS, FX 


® Encompasses all effect resources 

Render state, texture state, variables, render 
targets, textures, models, etc... 
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RenderMonkey - What’s 

new? 






Support for OpenGL ES 2.0 

ES Shading Language vl.OO 
ES syntax highlighting 
ES render/sampler states 
Large suite of ES examples 
User editable vertex attribute names 
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RenderMonkey - What is 
Different with ES Shaders? 


® Generic vertex attributes 


® User varyings 



uniform mat4 view_proj_matrix 
uniform vec4 view_position; 
uniform vec4 lightPos; 
uniform vec4 lightDir; 


Cancel 


IFLOAT3 


attribute vec4 rm_Vertex; 
attribute vec3 rm_Nonnal; 
attribute vec3 rm_Tongent; 
attribute vec3 rm_Binormal ; 
attribute vec3 rm_TexCoordO 


BINORMAL 


IFLOAT3 


va- ^ ■ j •Tiix'"'.' . { 

varying vec3 vLightVec 
varying vec3 vLightDir 
varying vec3 vViewVec; 


varying veo3 vTangent; 
varying vec3 vBir.ormal 


gl_Position = view_proj_matrix * rm_Vertex 


// construct a tangent space matrix from tan/binorm/no: 
mats tanSpace = mat3( rm_Tangent, rm_Normal, rm_Binorm< 


vec3 tangent 
Vftc3 normal 


vec3( rm_Tangent.x 
vftcS^ rm NTormal .x 


rm_Tangent ,y, rm. 
rm Normal .v. rr 




-- 


'iX, 












DataTyp 


Lit Object 

^ Vertex Program i ^ Fragment Program I 


Reset 


NORMAL 


3 |FL0AT2 


TEXCOORD rJ 

TANGENT ^ 
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RenderMonkey - What is 
Different with ES Shaders? 

Most built-in uniforms removed 

® G-9- gl_ModelViewMatrix 

@ RenderMonkey provides equivalent user named 
uniforms 

Default precision qualifier required for FS 
Various limitations: 

Loop constructs 
Relative addressing 

Extension enabling with #extension: 

3D Textures, derivatives 
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RenderMonkey - What is 
Different with ES Effects? 

Reduced render state 

@ Alpha test must be done with discard 
@ No polygon fill mode 
@ No fixed-function state: fog, point size, etc. 

Reduced sampler state 

@ Less texture wrap modes 
@ No fixed-function LOD bias 
@ No texture border color 
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RenderMonkey - Demo 



jpull Uar Paint Effect ^ 

P! Vertex Shader ES SL ^ Fragment Shader ES SL | 


#ifdef GL_FRA6MEOT_PRECISI0N_HI6H 
// Default precision 
precision highp float; 

#else 

precision mediump float; 

#endif 


uniform float microflakePerturbation; 
uniform float brightnessFactor; 
uniform float glossLevel; 
uniform vec4 paintColorMid; 
uniform vec4 paintColor2; 
uniform vec4 f lakeLayerColor; 
uniform float normalPerturbation; 
uniform float microflakePerturbationA; 
uniform vec4 paintColorO; 
uniform sampler2D normalMap; 
uniform sampler2D microflakeNMap; 
uniform samplerCube showroomMap; 


// Phenomenological car paint visual effect: Simulates build up o 
// on the metallic surface of a car or any other object. This vis 
// emulates the suspended layers of microflakes in the paint coat 
// blends between several colors of paint based on the viewing am 

// 

// Author: Natalya Tatarchuk 

// (based on the original assembly shader written by John Is 
// 

// Used in ATI’s Gar demo fnr Rarienn ^7fin launch, found here: 


^ATI RenderMonkey 1.70 : MuItiTone Car Paint.rfx 


MM 


B Output 


Cannot compile shaders in 'Full Car Paint Effect' effect because the OpenGL ES preview window is closed. 

Please open the OpenGL ES preview window to compile shaders. 

OpenGL ES Preview Window: Compiling fragment shader API (OpenGL ES) /Car Paint EffectGroup_OpenGL ES/Full Car Paint Effect/Full Car Paint Effect/Fragment Shader ES SL/ ... success 
OpenGL ES Preview Window: Compiling vertex shader API(0penGL ES) /Car Paint EffectGroup_0pen6L ES/Full Car Paint Effect/Full Car Paint Effect/Vertex Shader ES SL/ ... success 
OpenGL ES Preview Window: Linking program . . . success 


Fie Edit View Window Help 


liaUPl: 


^ Workspace 


f 


X , OpenGL ESPrevl...tEffert effect Shader Editor ;...ar Paint Effect | 


S mcroHakeNMap Q ^ 

® normalMap ^ 

9 ShowroomMap 
standard mapping 

•if Car 

- U Car Paint Effect Group_DX9 

ff © MuiCTone Car Paint w/out Env. M< 

L+ © Environment Map Only Effect 
s © MuItiTone Car Paint 
i± © One Tone Microflake Effect 
s © Ful Car Paint Effect 

- ^ Car Paint EffectGroup_OpenGL ES 

E ES MuNJTone Car Paint w/out Env. Mi 
L+: ES Environment Map Only Effect 
E ES MuItiTone Car Paint 
K ES One Tone Mtrofiake Effect 
E ES Full Car Paint Effect 
^ Camera 

B Ful Car Paint Effect 
^Camera 

ll flakeSingleLayerColor 
g^Car 

JH Vertex Shader ES SL 
SJ Fragment Shader ES SL 
ffl 5 j< normalMap ^ 

E Si microflakeNMap ^ 
a 5}i showroomMap 
^ standard mappmg v 

> 

il EBecI I W Alt I 


ArtKt Editor 


Shader Editor : Full Car Paint Effect 


O showroomMap 0S 
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OpenGL ES 2.0 - 3D Engine 

Study 








Sushi Demo Engine 


© AMD’s Demo Engine 
© Support for: 

DX9 
DXIO 
OpenGL 
OpenGL ES 2.0 
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Key Challenges 


© Designing an engine to target multiple 
APIs with different feature sets 

© Designing a shader-based engine 


© Platform compatibility 

Large variance in handheld platform 
capabilities 

Limitations make portability a challenge 



WWW.GDCONF.COM 



Abstracting the Graphics API 

® Challenge: what level to abstract the 3D 
API? 

Support all features of all APIs? 

Support common set of features? 

How to handle different shading languages? 
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state of the APIs - 2005 



AA Lines/Points 
Edge Flags 
Polygon Fill Modes 
Texture borders 
Two-side polygons 

10.10.10 vertex data 
FP16 vertex data 
Multisample RT’s 
R/RG texture formats 

Common Features 





•In 2005, we abstracted the DX9 feature set. 

•We used extensions to support missing features in OpenGL. 

*• i; 

CMr' 
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state of the APIs - 2007 



•The choice is no longer so easy. 

•Especially if you add game consoles to the mix... 
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Abstracting the API - How We 

Decided 

® Driven by requirements: 

Demos must use the latest features of all 
APIs 


Exposing the lowest-common denominator 
not an option 

® Running the same demo on each API not 
a requirement 

® Let content drive the feature set rather 
than the API abstraction 
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Abstracting the API - What 

We Did 





© Our API abstraction looks a lot like DXIO 
Resources 
Views 


Geometry Shaders 
Stream Out 

All the latest and greatest features... 

© Each API implementation supports a 
subset of these features 

" i: 

CMr' 
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API Abstraction - Fallback 

Paths 

© Demo Engine is based off a scripting 
system using Lua 

© Lua script provides fallback rendering 
paths. 

© Trade off: High end features vs. Content 
portability 

For Sushi, this was a fair tradeoff to make 
It might not be for you .. . 
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^ Sushi - Effect System 


^ hiijg ZOQTin ■ 


5 Encapsulate essential information about 
rendering techniques 

® Essential part of shader-based engine 


Develop our own? 
Use someone else’s? 


@ Microsoft .FX 
@ COLLADA FX 


@ CgFX 

® At the time, no existing solution fully fit 
our requirements 


WWW.GDCONF.COM 



Sushi - Effect System Goals 


© Multiple API / Shading Language Support 

HLSL, GLSL, ES SL 

© Flexible support for advanced rendering 
techniques 


The effect system is the foundation that all 
the demos are built on 
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Sushi Effects - Cross-API 
Effect System 

® Expresses the following data: 

Shaders 
Render State 
Passes 
Techniques 
Variable Bindings 


® Similar to Microsoft .FX, but multiple API 
support 
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Shader Authoring 

© Many of our shaders authored in HLSL 
© Needed a way to convert to: 

OpenGL Shading Language 
OpenGL ES Shading Lanauge 

© Wrote a tool for this purpose: 

HLSL2GLSL 
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HLSL2GLSL 


^ \ I, Ji ZOQTin ' 


Command-line tool and library 
Converts SM 3.0 HLSL shaders to 

GLSL vl.10.59 shaders 
ES SL vl.OO shaders 

Open-source: 


http://sourceforqe.net/proiects/hlsl2qlsl 
Very flexible BSD license 
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^ Sushi - Platform Portability 


ZOQT in ' 


Handheld platforms have many 
constraints: 

Examples: 


@ No Standard Template Library 
@ No C++ Exceptions 
@ Manual Cleanup Stack 
@ Incomplete Standard Libraries 
@ Limited Memory Footprint 
@ No Floating Point Unit 
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V Sushi - Portability 


^ hiijg ZOQTl" ■ 


Standard abstraction layers 

Math, I/O, Memory, Window, etc, 

Custom template classes 

Lists, vectors, maps, etc. 

Constrained use of C++ 


No exceptions 
No STL 
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Summary 


© Tools 

OpenGL ES 2.0 Emulator 
RenderMonkey w/ OES 2.0 Support 


© OpenGL ES 2.0 3D Engine Case Study 
Graphics API Abstraction 
Effects System 
Portability 
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Questions? 

dan.qinsburq@amd.com 
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